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SECTION  I 


INTRODUCTION  AND  OUTLINE 

I 

In  recent  times  there  have  been  many  attempts  at  extending 
the  analysis  of  stationary  time  series  to  classes  of  nonstationary 
cases.  The  fundamental  spectral  analysis,  so  useful  for  the 
stationary  series,  does  not  play  such  a central  role  in  the  general 
study.  The  necessary  tools  and  methods  for  an  analysis  of  the 
latter  are  different  and  altogether  less  refined,  and  still  appear 
more  complicated.  However,  from  the  point  of  view  of  applications,  ^ 

the  analysis  of  nonstationary  time  series  is  perhaps  more  realistic.  jj 

I Consequently,  some  results  based  on  certain  asymptotic  consider-  | 

ations  related  to  a 'correlation  characteristic'  (to  be  defined 
below)  will  be  presented  in  this  paper.  Also  included  is  some 
other  work  on  classes  of  linear  stochastic  (or  autoregressive) 
equations  in  discrete  as  well  as  continuous  time.  An 
outline  of  the  results  will  be  useful  here,  since  it  gives  the 
reader  a bird's-eye  view  of  the  treatment.  i 

i Instead  of  totally  abandoning  the  spectral  point  of  view, 

Kamp4  de  Feriet  and  Frenkiel  in  1959  have,  in  a remarkable  paper, 
introduced  a class  of  nonstationary  time  series  (to  be  called 
class  (KF)  hereafter)  for  its  covariance  analysis  (cf.  [1]). 

There  they  studied  in  considerable  detail  a model  which  is  of 
the  form  signal  plus  noise,  where  the  signal  is  a time  series  with 
zero  means  and  a periodic  covariance  and  the  noise  is  a stationary 
series  with  zero  mean.  A detailed  numerical  study  was  made  to 
illustrate  the  usefulness  of  this  class.  Also  only  slightly 
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Later,  but  independently,  Parzen  [2]  has  considered  such  a model 
briefly  and  termed  it  "asymptotically  stationary."  This  class  (KF) 
has  been  discussed  in  some  detail  by  Bhagavan  [3]  in  his  recent 
dissertation.  There  one  of  his  main  results  asserts  that  the 
class  of  harmonizable  time  series  belongs  to  class  (KF)  , and 
then  an  ergodic  theorem  was  obtained.  In  Section  II  below,  the 
class  (KF)  has  been  further  analyzed  and  a more  inclusive  (new) 
almost  harmonizable  class  was  introduced  and  shown  to  be  of 
class  (KF)  . This  contains  the  harmonizable  case,  but  the  gene- 
ralization gives  a better  insight,  and  shows  the  simplicity  of 
class  (KF)  . The  consistency  of  an  estimator  of  the  averaged 
mean  function  and  a weak  law  of  large  numbers  are  established. 

It  is  of  interest  to  remark  that  the  classical  spectral  theory 
of  stationary  time  series  again  plays  a role  here perhaps  just- 

ifying the  terminology  of  Parzen's  noted  above.  There  are  some 
relations  between  a class  of  series  introduced  by  Cramdr  in  (1951), 
(cf.  [4]),  called  class  (C)  , and  (KF)  though  either  does  not 

include  the  other.  X comparison  of  these  approaches  is  also  ex- 
pounded here,  and  these  relations  reappear  at  many  places  in  the 
rest  of  the  paper. 

Section  III  is  devoted  to  the  covariance  analysis  of  time 
series  governed  by  difference  schemes  with  not  necessarily  con- 
stant coefficients.  Such  equations  are  of  interest  in  treating 
trend  and  seasonal  variations  in  various  situations  which  are 
typically  (strongly)  nonstationary  (cf.  Hurwicz  [5]).  Under 
some  conditions  on  these  coefficients,  it  is  shown  that  such 


generated  series  belong  to  class  (KF)  . In  general  many  do  not. 
Some  of  the  latter  cases  have  been  analyzed  in  detail.  In  order 
to  understand  the  dependence,  approximate  recursion  equations  for 
sample  covariances,  which  are  the  sample  analogs  of  the  ancient 
Yule-Walker  equations,  are  presented  when  the  coefficients  have 
linear  "time  trend."  For  a descriptive  study,  correlograms  (= 
the  graph  of  (k,p^(k))  where  Dj_(k)  is  the  correlation  of 
with  ) 3nd  certain  approximations  are  considered.  Even  here, 

the  computations  become  involved,  but  what  may  be  expected  in 
higher  order  schemes  is  evidenced.  Some  other  results  on  esti- 
mation and  limit  behavior  of  normalized  sums  are  also  included. 

The  continuous  time  analog  of  the  preceding  work  refers  to 
the  behavior  of  flows.  This  is  considered  in  some  detail  in  (the 
final)  Section  IV.  The  corresponding  schemes  are  stochastic  dif- 
ferential equations  whose  coefficients  are  functions  of  time.  The 
importance  of  a class  of  these  schemes  in  industrial  applications 
has  been  reported  by  Hartley  [6] . If  the  coefficients  are  con- 
stants, they  represent  the  motion  of  a simple  harmonic  oscillator, 
driven  by  random  (or  white  noise)  disturbance,  and  such  a model 
has  already  been  discussed  in  1943  (and  in  earlier  classical 
studies)  in  the  important  long  article  of  Chandrasekhar  [7].  The 
latter  type  of  equations  have  been  analyzed  by  Dym  [8],  and 
classified.  The  general  time  dependent  case  is  much  more  in- 
volved, and  some  properties  of  such  an  equation  are  studied. 

Several  results  from  the  theory  of  ordinary  differential  equations 
have  special  interest  here.  The  basic  sample  function  continuity 


of  the  solutions  and  the  conditions  under  which  they  belong  to 
class  (KF)  and  the  fact  that  they  always  belong  to  class  (C)  , 
among  others,  are  established.  A specialization  of  the  case  when 
the  coefficients  are  constants  is  illustrated,  and  the  correlogram 
is  analyzed  for  its  asymptotic  behavior. 

The  results  presented  show  how  new  problems  must  be  attacked 
for  a more  complete  understanding  of  these  time  series.  In  par- 
ticular, the  classification  of  the  solutions,  analogous  to  [8], 
will  be  very  interesting.  Some  aspects  of  this  for  vector  valued 
time  series  have  been  already  given  by  Goldstein  f9] , but  the 
sample  function  behavior  when  the  disturbance  is  white  noise,  as 
in  [8],  has  not  been  done.  The  feasibility  of  such  a study  is 
strongly  indicated  in  the  present  work.  Similarly,  many  other 
connections  and  scenic  byways  are  noted  but  not  pursued.  Hope- 
fully such  work  will  be  considered  in  the  future. 

It  is  recognized  that,  especially  in  time  series,  no  result 
can  be  taken  without  adequate  demonstration  (or  at  least  the  ex- 
planations that  can  easily  be  made  precise).  For  this  reason 
■ essentially  all  proofs  appear  along  with  the  statements  of  results 

if  an  adequate  reference  is  not  at  hand.  Consequently,  readers 
primarily  interested  in  the  results  are  advised  to  skip  the  proofs 
and  proceed  with  the  statements,  discussions,  and  remarks  of  the 
paper . 
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SECTION  II 


A GENERAL  CLASS  OF  NONSTATIONARY  TIME  SERIES 

Let  X = [X^jtcH]  be  a second  order  (real  or  complex)  time 
series  with  zero  mean,  and  covariance  K(s,t)  = E(X^X^)  . (The 
expectation  E is  on  a fixed  probability  space  on  which  X^  is 
defined.)  Suppose  that  the  K(-,-)  satisfies  the  following 
condition : 

T-|h| 

(KF)  r(h)  = lim^J  ^ K(s-^, s+^)  ds 
T-»^  (h|/2  2 ^ 

= ( lim  ^ ^ K(s  , s+l  h I )ds  = limr.p(h)),  h^IR  , 

T-co  I 0 T-*» 

where  the  limit  is  assumed  to  exist.  This  condition  was  intro- 
duced by  Kampe  de  Fdriet  and  Frenkiel  [1].  The  class  of  time 
series  X satisfying  the  above  condition  will  be  called  the 
class  (KF)  , and  it  is  analyzed  in  detail  in  what  follows.  It 
will  become  clear  that  this  class  (KF)  is  sufficiently  general 
and  is  very  useful  in  applications.  The  interest  in  this  defi- 
nition stems  from  the  positive  definiteness  of  r.^  and  r , as 
stressed  in  [ 1 ] . 

It  is  clear  that,  if  X is  (real  and)  stationary,  so  that 
K(s,t)  = K(t-s)  , then  r(h)  = K(h)  = K(|h|)  . Thus  every 
stationary  process  is  in  (KF)  . If  X = Y+Z  , where  Z = 
[Zj.,t']R}  is  stationary  (with  zero  mean)  and  Y = [Y^,t'lR} 
has  zero  mean  and  a periodic  covariance  (i.e.  Ky  (s-Hiq  , t+h^)  = 
Ky(s,t)  for  some  "period  hQ  ")  E(Y^Z^)  = 0,  t€lR  , then  also 


X?class  (KF)  , but  now  X is  evidently  not  stationary.  In  this 
representation,  the  output  X is  composed  of  the  "signal"  Y 
and  "noise"  Z which  are  mutually  uncorrelated,  and  the  model 
describes  a communication  channel.  An  elementary  example  of  the 
Y-process  is  the  following: 

Yj.  = a cos  2:^t  , t€IR  , (1) 

9 2 

where  E(a)  = 0 , E(a“)  = a >0  . Then  Y is  nonstationary  and 
^2 

KY(s,t)  = — [cos  ^(t+s)  - cos  n(t-s)  ] . In  this  example  r^(h)  of 

2 

(KF)  is  given  by  r^,(h)  = (h ) + ^ cos  ih+o  (T)  so  that  Xtclass 
(KF)  . Also  if  Kj^(t  ,t+h)-a(h)  as  t-“  for  each  h where 
-”<a(h)<°°  , then  (by  the  L'Hospital  rule)  it  follows  that 
X€class  (KF)  . Another  example  of  X in  (KF)  is  the  important 
nonstationary  class  called  the  harmonizable  time  series.  Namely, 
if  the  covariance  of  X is  denoted  by  K^  , then  it  is  repre- 
sentable as: 


Kj^(s,t) 


is\-it^  ,2  . 

e d v(\,..-) 


(2) 


where  y(',‘)  is  a covariance  function  of  bounded  variation  on 
the  complex  plane  (or  on  the  square  (-n  ,n]  x (-t  ,t' j if  the  time 
series  is  of  discrete  parameter).  K^  is  then  called  a harmo- 
nizable covariance.  That  this  series  X is  in  class  (KF)  is 
nontrivial  and  it  is  one  of  the  main  results  of  the  dissertation 
[3].  There  is  a more  inclusive  class  of  Cramdr,  to  be  called 
class  (C)  , generalizing  (2)  ; it  will  be  recalled  here  for  com- 
parison with  (KF)  and  for  later  use. 
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The  time  series  X 


= X^.  ,t']R}  is  said  to  be  of  class  (C)  , 

if  it  has  mean  zero  and  covariance  , representable  as  : 

K^(s,t)  g(s,,V)gTt,p)d^v(\  ,a)  (3) 

* —00  -CO 

where  v is  a covariance  function  of  bounded  variation  on  each 
finite  domain  of  the  complex  plane,  and  [ g (t , • ) , t'  IR  i is  a 
family  such  that  the  integral  in  (3)  exists.  is  then  called 

a covariance  of  type  (C)  . Thus  if  v is  of  bounded  variation, 
g(s,0  ~ e^^  ' , then  (3)  reduces  to  (2).  The  problem  now  is  to 
find  conditions  on  g and  v in  order  that  X of  class  (C) 
is  in  class  (RF)  . The  class  (C)  has  been  analyzed  from  the 
point  of  integral  representation  by  the  author  [lOj,  and  con- 
siderable information  is  available  for  this  family. 

For  comparison,  it  will  be  useful  to  state  the  above-noted 
result  from  [3]  in  the  following  form.  It  is  seen  to  be  included 
in  a more  general  result  proved  Tiext. 

Proposition  2.1.  Let  K be  a continuous  harmonizable  covariance. 
Then 

R(h)  = lim^^'*'  ^ ^ K(t , t-r|  h I )dt  , hGIR  , (4) 

T—  ^ " 0 

exists  and  R(-)  is  a stationary  covariance  so  that 

R(h)  = e^*^'  dF(>,  ) , K^IR  , (5) 

- -o 

for  a unique  distribution  F ( F (-h° ) -F”  (-* ) = R(0)  ).  Moreover, 

F('  ) = Y (”  ,™)  - Y 1 -'O  (^) 

where  v is  the  covariance  given  in  (2). 
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In  the  discrete  case  there  is  a corresponding  formula  (anal- 


ogous to  (4)-(6)),  but  the  relation  (6)  can  be  given  a more  de- 
tailed form  using  the  possible  discontinuities  of  v . (It  was 
treated  in  i'3j.)  The  proof  of  this  result  uses  estimates  of 
trigonometric  sums  for  integrals  on  bounded  rectangles  arising 
from  fe^*'^,t']R}  . In  the  case  of  (3),  it  is  clear  that  one 
has  to  restrict  the  family  [ g(t , • ) , tC]R  ] regarding  its  growth 
in  relation  to  \ • In  general,  the  limit  (4)  for  K's  of  type 
(C)  need  not  exist.  Thus  the  class  (C)  is  not  included  in 
class  (KF)  nor  is  the  class  (KF)  contained  in  the  class  (C)  . 

(See  the  example  in  remark  following  Theorem  4.2.)  Some  inter- 
esting conditions  on  g will  be  obtained  so  that  those  time 
series  are  in  class  (KF) 

Let  g of  (3)  be  a bounded  (jointly)  continuous  function. 

It  will  now  be  shown  that,  if  g(-,X)  is  almost  periodic  for 
almost  all  X (in  particular,  g(t,>. ) = e^*"‘  is  automatically 
included),  then  the  corresponding  class  (C)  covariance  actually 
is  in  (KF)  so  that  (4)  and  (5)  are  implied.  It  is  necessary  to 
recall  the  definition  of  almost  periodicity  of  g , depending  on 

the  parameter  \ , to  demonstrate  the  preceding  statement.  ! 

I 

Definition . Let  D c be  an  open  (or  a compact)  set.  A con-  j 

tinuous  complex  function  f on  RxD  is  said  to  be  almost  peri-  , 

odic  (a . p ■ ) on  R uniformly  relative  to  D if  for  each  compact 

set  S c-  D , f(-,x)  is  almost  periodic  for  each  x in  S , | 

i.e.,  for  any  e >0  , and  each  compact  set  S c D , there  is  a 

number  j5q  = Xq(€,S)>0  , such  that  each  interval  I r- R of 

8 


t 


'"m 


(7) 


length  Iq  contains  a number  "‘HI  for  which 

|f(t+t,x)-f(t,x)[ie  , t'RjX'S  . 

The  T is  called  an  € -trans lat ion  number  of  f . 

It  can  be  shown  that  the  set  of  all  a.p.  functions  de- 
pending on  a parameter,  satisfying  (7),  forms  an  algebra,  and  if 
I f (t ,x) ( . ag>0  for  x'S  c D , and  all  t ' IR  , then  y is  also 
an  a.p.  function  of  the  same  kind.  Thus  the  set  [e^^^  , t'lR  , H ]R 
is  included  in  the  above,  and  in  fact  properly.  For  an  exposi- 
tion of  this  class,  the  reader  may  consult  Yoshizawa  (fll). 
Chapter  1).  If  D = {t]  is  a single  point,  then  this  definition 
reduces  to  the  classical  concept  of  a.p.  functions  of  Bohr.  Also 
observe  that  an  a.p.  function  is  only  locally  (i.e.  on  bounded 
intervals)  integrable.  In  fact,  it  is  bounded  for  each  x'S  c D 
The  following  is  the  desired  generalization. 

Propos ition  2.2.  Let  K be  a covariance  function  of  type  (C)  , i 
one  which  satisfies  (3).  Suppose  that  g(-,>)  of  the  integrand  in 
(3)  is  almost  periodic  uniformly  relative  to  ■,  D = K and  with 
V as  the  covariance  of  bounded  vai'iation.  Then  the  time  series 
X = [X^,t'^]R}  with  zero  mean  and  covariance  K belongs  to 
class  (C)''class  (KF)  . More  precisely, 

R(h)  = Iim|r  "'^■|^lK(t,t+|h|  )dt  = limR  (h)  , h^IR  , (8) 

T-.-0  ^ ^ 0 T— 

exists  and  defines  a stationary  covariance  on  F . 

Remark . If  g(t,X)  = e^^*^  , then  the  hypothesis  of  this  propo- 
sition is  satisfied  by  that  of  the  preceding  one  so  that  the  main 
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result  (4)  is  a consequence  of  (8).  Using  the  special  form  of 
this  g , it  is  possible  to  obtain  (6)  connecting  v and  the 
spectral  distribution  F of  R . However,  in  the  present  gener- 
ality, such  a relation  as  (6)  is  much  more  involved. 

Proof . By  symmetry  it  suffices  to  consider  h - 0 . Now  substi- 
tuting (3)  into  R,j,  above  and  interchanging  the  integrals  (this 
is  obviously  legal) 

R-p(h)  = f , X )grt+h,>, ' )dt  d^v  (X  , \ ' ) . (9) 

^ -as  -CO  0 

If  S cR  is  any  compact  set,  and  g(-,\),  /.?S  , is  a.p.,  then 
it  follows  that  g(- ,X)g(-+h,X'),  (X,X')  SxS  , is  also  a.p.  So 
for  any  fixed  but  arbitrary  h , one  has  by  a classical  result 
(cf.  Besicovitch  [12J,  p.  15), 

lim  lim  )g(t+h  ,X  ' )dt  =a(h;X,\')  , (10) 

X-»=o  X—"”  0 

exists  uniformly  in  h . But  it  is  clear  chat  a(h;X,X')  is 
bounded  for  all  h=i0,  (X,x')-SxS  since  each  a.p.  function  is 
bounded.  So  from  (9)  and  (10),  together  with  Dominated  Conver- 
gence, one  gets 

R(h)  = limR„(h)  = . (11) 

'T* J-  — 


But  for  each  T , R.p(')  is  clearly  positive  definite  and  hence 

so  is  R(’)  . Thus  R(‘)  is  a covariance.  However,  due  to  the 
compactness  of  S and  the  uniformity  involved  in  (10),  it  follows 
that  a( •;•,•)  on  RxSxS  is  a continuous  complex  function.  From 
this  one  easily  concludes  that  R(')  is  a (continuous)  stationary 
covariance  and  then  the  representation  (5)  is  just  the  classical 


Bochner's  theorem.  This  completes  the  proof. 


Comments . 1 . Evidently  one  may  prove  an  analogous  result  if  the 

time  series  is  of  discrete  parameter.  It  should  be  observed  that 
the  long  argument  of  the  harmonizable  case  of  Bhagavan  (cf.  [3], 
pp.  72-77)  is  really  a specialized  version  of  the  existence  of 
the  limit  (10)  and  for  the  special  g(t,\)  = e^^^‘  (the  "charac- 
ters" of  R ) the  mean  value  is  given  by  the  values  of  (10)  on 
the  diagonal  (cf.  (12),  p.  16,  no.  4°)  so  that  the  simplifications 

for  (6)  result.  In  the  general  case  (6)  no  longer  holds.  Now  X 

2 

is  mean  continuous,  i.e.  E(Xj_-X^)  -0  , as  s-t  , so  one  has 
only  : 

R(h)  = a (h;X  ,X  ' )d^v  (X  ,\ ' ) = e^’^^dF(x),  h'lR  , (12) 

— TO  —X*  —TO 

by  the  Bochner  theorem.  This  F will  be  called  the  assoc iated 
spectral  distribution  of  X . 

2.  The  time  series  X = {Xj.,t'3lR}  whose  covariance  K is 

of  type  (C)  (and  E(Xj.)=0)  for  an  a.p.  function  p(‘,X)  , 

uniformly  relative  to  R , may  and  will  be  called  an  a Imps t 

harmonizab le  ser ie s . This  clearly  includes  the  harmonizable 

case.  Under  this  generalization,  one  may  profitably  consider 

2 

the  more  inclusive  Besicovitch  functions  g (=B  - a.p.  of  [12]), 
a.p.  uniformly  relative  to  R , since  for  such  functions  the 
desired  limit  (10)  again  exists.  This  follows  from  ([12],  p.  93), 
where  one  uses  the  fact  that  such  g's  form  an  algebra  and  then 
Lemma  4 is  applied  there  in  a slightly  modified  form  (and  con- 
sequently the  arguments  on  pp . 14-15  of  (12|  hold).  This 


T 


extension  is  necessary  to  show,  for  instance,  that  the  Brownian 

motion  (which  is  not  harmonizable)  is  covered  by  the  above.  That 

the  latter  is  in  class  (KF)  is  easy  to  check  directly  as  observed 

in  [1]  . Similarly  the  Ornstein-Uhlenbeck  process  is  in  (I'F)  . Both 

2 

these  are  now  almost  harmonizable  (g  is  not  continuous,  so  B 
a.p.  is  needed!).  It  will  be  interesting  to  analyze  this  set 
which  is  contained  in  class  (KF)'class  (C)  . Here  one  should 
perhaps  also  observe  that,  if  g is  B -a.p.  so  that  a(h;,',  )-0 

as  I '"L I I M sufficiently  rapidly,  then  v need  only  be  of 
bounded  variation  on  each  compact  rectangle  of  the  complex  plane. 

3.  It  may  also  be  remarked  that  g of  (3)  can  be  more 
general  than  that  noted  above  for  the  existence  of  the  limit  in 
(10).  For  instance,  if  g is  locally  (i.e.  on  compact  sets) 
square  integrable,  then  g ( • , >- ) g ( • +h  , X ) will  be  (c,l)  summable 
(i.e.,  in  the  sense  of  first  arithmetic  mean  of  Cesaro)  while 
is  of  bounded  variation.  Many  good  sufficient  conditions  are 
available  for  it  in  the  literature  . This  shows  that 
class  (KF)  class  (C)  contains  even  the  almost  harmonizable  family 
as  a proper  subset. 

One  of  the  key  applications  of  the  above  result  is  in  ob- 
taining conditions  for  the  weak  or  strong  law  of  large  numbers. 

In  a different  terminology,  this  is  equivalent  to  estimating  the 
mean  (or  the  average  of  the  mean  function)  of  the  time  series  X 
consistently.  These  problems  are  natural  analogs  of  the  well 
known  stationary  theory  (cf.  Doob  [13],  pp.  529-530).  The  fol- 
lowing is  such  an  extension  and  it  is  substantially  due  to  Bhagavan  [3], 
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Proposition  2.3.  Let  X = [X^,t"]R]  be  an  almost  harmoniz- 

able  time  series  (which  is  mean  continuous).  Suppose  that  its  mean 

function  m has  the  property  that  a^,  = lim^^  ^m(t)dt  exists 

^ ^ 0 

1 rri 

where  m(t)  = E(X  ) . If  ih„  = X dt  (the  sample  path  inte- 

t i i “ Q t 

- 2 

gral),  then  lim  E (m.j,-aQ)  = F(0+)-F(0-)  , where  F is  the  assoc- 

'J’— ♦CO 

iated  spectral  distribution  of  X (cf.,  (12)).  In  particular,  if 
F is  continuous  at  0 , then  m.p  is  a strongly  consistent  esti- 
mator of  aQ  (or  the  series  X obeys  the  weak  law  of  large 
numbers  when  the  limit  a^  exists). 

1 T* 

Proof.  Let  a.^  = — '’^m(t)dt  , so  that  a.„-*a^  as  T-'"  . Then 

1 i ^ 0 i ^ 

writing  K(s,t)  = Cov (X  ,X  ) , the  covariance,  and  noting  E(m„)  = 

S U i. 

a.j,  , one  has : 

E(m.j,-aQ)^  = E[(m.j,-a.j,)  + (a.j,-aQ)]^  = 2 [E(m.j,-a.j,)^+(a.p-aQ)^] 

= -Yo"^."^K(s,t)dtds  + 2(a  -a^)^  , 

TOO  ^ ^ 

= |;^^RT(h)dh  + 2(aT-ao)^  (cf.  (8)).  (13) 

The  last  term  of  (13)  tends  to  zero,  and  the  first  term  may  be 
simplified  as  follows.  If  R.j,  did  not  depend  on  T , then  the 
limit  of  the  first  term  of  (13)  is  the  desired  result,  and  it  is 
a classical  theorem  of  Bochner  (cf.  Cramer  [14],  p.  25).  Since 
by  Proposition  2 (since  X is  mean  continuous),  R.^,  is  a con- 
tinuous positive  definite  function  converging  to  a continuous 
positive  definite  R which  then  has  the  representation  (12),  a 
simple  modification  of  Bochner 's  proof  establishes  the  present  case 


Let  and  F be  the  bounded  nonnegative  nondecreasing 

functions  representing  and  R , as  in  (12).  Then  R^(h)-R(h) 

uniformly  for  h on  each  bounded  closed  interval  and  these  are 
Fourier  transforms  of  F^,F  which  must  then  be  uniformly  bounded. 
Moreover  F.j,-F  at  each  continuity  point  of  F by  ([14],  Thm.ll). 
Thus 

Rj(h)dh  - 

- ^iS^dF^(x)  . (14) 

»co 

Since  ~*^0x  ^ ^Ox  delta  function)  and 

F.J.-F  the  result  follows  easily.  In  fact,  for  each  e >0  , 

sinTx  jT-  / \ _ ■’-s  , s in  Tx  / s , ->€  sin  Tx  /ic\ 

— t3T"  — X}^  ^ 

*00  * 00  c * r 

The  first  two  integrals  on  the  right  side  of  this  equation  go  to  zero 
as  T-“  since  | ^ I ^ ^nd  F.j(x)  s sup  F.j,(^)  < * . Let 

e be  chosen  so  that  (F (€ ) -F (-€ ) ) - (F (0+) -F (0- ) ) - e/2  and  that 
±s  is  a continuity  point  of  F . This  can  be  done  since  the 
continuity  set  of  F is  everywhere  dense  in  R . But  [ ^ I • 1 > 
and  if  T is  large  then  F.^,  (e ) -F.^,  (-e  ) differs  arbitrarily 
little  from  F(c)-F(-s)  , and  it  follows  that  the  last  term  of  (15) 
differs  from  F(0+)-F(0-)  by  less  than  e . Since  e >0  is 
arbitrary,  one  concludes  that 

lim^;'^  R.„(h)dh  = F(0+)-F(0-)  = lim^'’'^  R(h)dh  . (16) 

X-01  -X  ^ T-'”  ^ -T 

The  proposition  now  follows  from  (13)  and  (16).  Note  that  when 

F has  a jump  at  0 , the  estimator  m.p  (of  3q  ) is  not 
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consistent.  This  completes  the  proof. 


Remark.  Since  the  limit  R and  hence  F are  given  only  indirectly 

from  R,^  , it  is  desirable  to  have  conditions  on  'R.j,,T>0}  that 

will  ensure  the  continuity  of  F at  0 (or  at  any  given  point). 

This  will  be  true  if  R.^, (h)-0  as  h— uniformly  in  T or  if 

|R  (h)|dh  is  bounded  as  a function  of  T . The  first  condition 
0 ^ 


ensures  the  statement  in  brackets  (by  the  classical  Riemann- 
Lebesgue  lemma)  and  the  latter  gives  the  continuity  of  F at  0 
as  the  last  part  of  (16)  shows. 

In  view  of  the  importance  of  R.^  and  R above,  the  immed- 
iate statistical  problem  is  to  estimate  these  functions,  with  the 
consistency  property,  at  least.  (Assume  m = 0 ; otherwise  one 
may  consider  the  product  moments  directly.)  Thus  the  natural 
estimates  are 


X A+h  -i"”  , 


(17) 


T 

where  for  , = 0 for  t>T  . Under  the  mean  con- 

tinuity  of  the  X , such  that  ’^K'^(t,t)dt  ' =»  , the  estimator 

" 0 

R^  of  (17)  is  well  defined,  E(R.p(h))  = R.j.(h)  an  unbiased 

estimator  of  R.^,  . To  fulfill  the  consistency  condition,  i.e. 

for  X€class  (KF)  , R.^,(h)-R(h)  , h€lR  , in  mean,  one  has  to  assume 

somewhat  more  on  X . The  following  sufficient  conditions  were 

given  by  Parzen  [2]  (cf.  also  (1]).  Thus  consider; 

(i)  for  each  t , assume  E(|Xj^|^)  , (ii)  if 

0 (t  1 , tz  , 1 3 > ) then  c is  Lebesgue  integrable 

1 2 3 '"4 
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on  each  bounded  interval  of  , and  (iii)  if  Cj_(v)  = 

J’*' Cov  dt  (which  exists  by  (ii)),  then  limCj.(v)  = 0 

0 t— “ 

for  each  v - 0 . 

If  (i)-(iii)  hold  then  Var(^(h))-0  as  T-0  , for  each 
h - 0 , so  that  E (h) -R(h)  )^-0  . This  may  be  checked  by  a 
direct  computation  (cf.  also  [2]).  In  [1]  an  interesting  example 
of  a periodic  covariance  of  a time  series  consisting  of  symmetric 
bounded  random  variables  is  given  which  satisfies  the  above  con- 
ditions. The  accuracy  of  the  approximation  of  the  estimator  with 
R was  then  illustrated  by  a numerical  example.  The  reader  is 
referred  to  this  instructive  case  in  [1]  to  gain  an  insight  into 
the  generality  of  the  class  (KF)  of  nonstationary  time  series. 

The  next  two  sections  will  now  be  devoted  to  another  class 
of  nonstationary  series  (= processes)  generated  by  certain 
stochastic  difference  and  differential  equations  for  which  a 
different  set  of  methods  will  be  needed.  The  latter  are  related 
to  the  "correlogram  analysis,”  and  these  will  be  discussed. 


SECTION  III 


NONSTATIONARY  SERIES  GENERATED  BY  DIFFERENCE  EQUATIONS 

(a)  Motivation . If  X = 'Xj.,t€lR}  is  a stationary  time  series, 
then  the  correlation  function  c(-)  is  given  by  p^(h)  = p (h)  = 
Cov(X^  ,X^^)/Var  Xj.  , and  is  independent  of  t . As  a function  of 
h , i.e.  of  the  lag , p(-)  is  taken  as  an  indicator  of  the  de- 


pendence of  X^  on 


for  large  h . Clearly  o(h)  = c (-h)  , 


lp(h)|-l  . Suppose  that  X is  nonstationary,  but  is  in  class  (KF) 
In  this  case  Pj.(*)  depends  on  t , but  for  any  a>0  , and  hflR  , 


1 -T-h 
T-a  - 


lim  prj,  (h)  = lira 

X-oo  ^ ^ X-» 


K(t,t+h)dt 


Here  R is  the  same  as  in  (8)  of  the  preceding  section  with 
K(s,t)  = Cov(X  ,X  ) . Since  R(-)  is  a stationary  covariance  by 

A c 

virtue  of  the  fact  that  X€class  (KF)  , p(-)  does  not  depend  on 

t or  a . Further,  several  properties  of  the  time  series  X are 
reflected  in  the  behavior  of  R and  hence  of  p . In  case  that 
X is  stationary  then  p = p . On  the  other  hand,  if  limK(t,t+h) 

a(h)  exists  (which  is  stronger  than  being  in  (KF)  ),  then  the 
limit  of  (1)  exists  and  one  gets  the  same  p(-)  . This  is  a con- 
sequence of  known  work  in  classical  analysis.  Motivated 
by  this  observation,  one  may  consider  the  behavior  of  p for  a 
class  of  nonstationary  time  series  where 


Pt^^^  VarX^ 


(2) 


called  hereafter  the  correlation  characteristic  of  X . In  general 
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0 is  not  a correlation  function,  but  asymptotically  its  behavior 
is  that  of  the  latter  (because  of  (1))  at  least  for  the  series  of 
class  (KF)  . In  this  section  the  time  series  governed  by  certain 
difference  (and  in  the  next  section  differential)  equations  will 
be  studied.  Some  of  the  following  material  (in  both  sections) 
appears  in  a very  tentative  form  in  the  author's  early  study  fl5]. 


(b)  A setting  of  the  problem.  Suppose  that  the  output  of  a noisy 
communication  channel  follows  a linear  model  of  signal  plus  noise 
type  as  follows.  The  output  at  time  t depends  on  the  im- 

mediate past  up  to  k units  linearly,  ana  then  a white  noise  dis- 
turbance enters.  Thus 


X. 


k 

= s 

i=l 


+ e 


t-i 


(3) 


where  aj^(-)  are  some  (non-stochastic)  functions  of  time  specified 
by  the  type  of  channel.  This  model  may  also  be  used  for  a dynamic 
economic  situation  where  are  called  "lagged  values"  of 

the  "endogenous"  variable  X^  or  sometimes  "exogenous"  variables 
also.  Thus  the  signal  is  a linear  function  of  the  past  k 

terms  and  [€^,tsl]  are  assumed  to  be  independent  identically 
distributed  variables  with  zero  mean  and  a finite  variance  ( = o , 
say).  Now  to  study  the  properties  of  X^  , the  difference  equa- 
tion (3)  may  be  solved  by  classical  methods  (due  to  D.  Andre, 
1878)  and  the  solution  is  given  by  the  expression: 
t-1  t+k-1 

X = S"3(t,i)--:  . + S cD(t,i)c^_.  , t2l  , (4) 

i=0  ^ i=0  ^ 


where  X^  - c^,  i=-k+l,...,0  , are  the  constant  initial  values. 
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and 


'■.0 


(t,m)  = 


S n a,  (t-  x:  k ) , 0sm-t,k„=0  , 

:,+---+k.=m  j=l  i r=0 

1 L 


(5) 


the  sum  ranging  over  all  partitions  of  m into  integers  k^ 

( ^0  ) (cf.,  Jordan  [16J,  p.  588).  For  instance,  if  = 0 and 
a^(t)  = , a constant,  then  the  complicated  looking  expressions 

(4)  and  (5)  reduce  to  familiar  forms.  To  see  this,  let  the 
characteristic  equation  of  the  difference  equation  (3),  namely. 


k ,k-l 


-a,  = 0 

k 


(6) 


have  simple  roots  . Then  (5)  becomes 


x(t,m)  = 23(t-m)  = S 3.x. 

j=l  J J 


t-m 


ls;m:i  t , S 3 . =1 
j=l  J 


(7) 


The  B.'s  further  satisfy 
J ^ 


K 1 

Ee,).?-!  • 0 , 


j-i  J J 


t=0 -k+2 


(7') 


For  a discussion  of  this  case,  see  Mann  and  Wald  [17]  and  the 
author  ([18],  p.  330).  Let  us  now  specify  conditions  on  the  model 


in  order  that  the  time  series  X = fX^,t2l]  be  in  class  (KF)  , 


and  point  out  instances  when  it  is  not  in  class  (KF)  but  for 


which  Pj.  of  (2)  has  a limit  as  t-'^ 


Since  for  an  asymptotic  study  the  initial  values  are  not 
important,  set  c^  = 0,  i=0 , -1 , . . . , -k+1  in  (4).  Suppose  further 


that  the  a^(-)  satisfy 


S |cp(t,m) 
m=0 


M 


t-U 


(8) 


Then  from  (4),  since  E(Xj.)  = 0 , one  finds 
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r 


t 


y 


s 


2 ® 

r(s,t)  = E(X  X ) = a S cp  (s  ,m)cp  (t  ,m)  , , 

^ m=0 

2 s 

= a S ® (s  ,m)cp  (s+h  ,m)  , h=t,s  . 
m=0 


It  follows  from  (8)  that  | r (s , s+h)  | for  all  h , and  s-^l  (by 
the  Cauchy  inequality).  Hence,  for  each  h^O  , 


, N-1 

lim  ^ r(s,s+h)  = R(h) 

N-*^  s=l 


(9) 


exists  (by  the  (c , 1 ) -summability  method),  and  by  symmetry  for  all 
h . This  implies  the  following  statement. 


Proposition  3.1.  If  a second  order  time  series  X = "X^,t-2l]  is 
generated  by  the  equation  (3),  and  the  a^(*)'s  satisfy  (8), 
then  the  nonstationary  series  X belongs  to  class  (KF) 

It  should  be  observed  that  the  condition  (8)  does  not  in- 
volve any  mention  of  the  roots  of  (6)  even  when  the  a^'s  are  con- 
stants. To  understand  the  significance  of  (8),  it  is  useful  to 
specialize.  Let  the  a^  be  constants  and  suppose  the  roots  of 
(6)  lie  inside  the  unit  circle  of  the  complex  plane  and  are  dis- 
tinct. Let  6 = max|x.l  so  that  6<1  . Then  (8)  is  automatic 

j ^ 

s ince 


E |co(t,m) 
m=0 


9 t t,-k  .^.2 

^ _ V I t V o , t-m 

- Z.  [c£)(t-m)(  - I ■ S.X. 

m=0  m=0^  j=l 


, by  (7), 


» Z/  3 . 3 . / I ^ JT — 

jj'=i  J J " 


t+i 


k 

E 


.]  ,J 


^ ^ 1-6^  l-A^  j,j'=l  ^ ^ 


k 

T, 


e . e . , 


= Mq<” 
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Thus  the  time  series  generated  by  (3)  with  constant  coefficients 
having  all  the  roots  of  its  characteristic  equation  distinct  and 
lying  inside  the  unit  circle,  belongs  to  class  (KF)  . On  the 
other  hand,  if  at  least  one  of  the  roots  of  (6)  is  on  or  outside 
the  unit  circle  (i.e.  5-1  ) then  the  resulting  time  series  gen- 

erated by  (3)  is  nonstable  or  explosive  and  will  not  be  in  class 
(KF)  . This  will  now  be  illustrated  by  a family  of  time  series, 
investigated  in  the  literature. 

Thus  in  the  constant  coefficient  case  of  (3),  let  6 >1  , 

5 = max  I \ . 1 of  (6).  Then  under  the  same  (remaining)  hypothesis 

j ^ 

as  above  , 


E(|X  |2)  = S |co(t,m)|2  = , 

t=0 


(10) 


so  that  (8)  is  violated  strongly.  This  was  shown  by  the  author 
([19],  Lemmas  8,  15).  Moreover,  by  ([19],  Lemma  9)  one  finds 

^ ^ A-(h-2) 


(h) 


Var  X, 


( ) , t-^  . 


(11) 


A similar  conclusion  holds  if  5 = l,k  = 1 , for  (10)  ( E(|X^|  ) = 
0(t  ) ).  These  two  cases  imply  that  the  limit  demanded  for  (KF) 
of  Section  II  cannot  exist,  and  so  these  time  series  do  not  be- 
long to  class  (KF)  . This  example  may  be  taken  as  a further 
justification  of  Parzen's  term  "asymptotically  stationary"  for 
the  series  in  classes  like  (KF)  (cf.  [2]). 

The  variable  coefficient  case  of  (3)  was  found  to  be  of  in- 
terest in  some  meteorological  applications  (cf.  [5]).  Consequently, 
a class  of  simple  variable  coefficient  schemes  will  be  investigated 
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in  some  detail  below.  They  will  throw  some  light  on  the  behavior 
of  the  resulting  time  series. 

(c)  A first  order  model.  The  correlation  characteristic,  given 
by  (2),  is  designed  to  reflect  the  dependence  of  on 

for  large  t and  h . It  was  noted  that  this  behaves  asymptot- 
ically (as  t-^  ) as  a correlation  function  for  members  of  class 
(KF)  . How  does  it  behave  in  the  "explosive"  cases?  Equation  (11) 
gives  an  indication  of  the  constant  coefficient  case.  Here  the 
variable  coefficient  model  of  first  order  will  be  considered,  for 
a striking  illustration.  This  is  also  the  one  proposed  in  [5], 
describing  a times  series  with  linear  trend,  namely, 

= a^^t-l'^^t  ’ ^t  " ’ til,aQ/0  . (12) 

The  series  consists  of  uncorrelated  random  variables 

2 

with  mean  zero  and  variance  " , X^  = 0,  t^O  (i.e.  the  initial 

values  are  zero) . 

The  solution  of  (12)  may  be  obtained  by  iteration.  Alter- 
t-1 

nately,  let  p^  = a^  so  Pj^  = a^  . If  we  set  » 

(12)  becomes 


h+i-^  ■ n'p, 


If  we  write  Xj.  = , the  solution  of  (13)  (hence  of  (12))  is: 


I* 


Since  Var  is  obtained  from  (15)  for  h = 0 , (2)  becomes: 

tH+i-1 
l = t 


(16) 


This  can  be  made  arbitrarily  large  for  large  h , for  appropriate 
aQ,a^  (e.g.  if  |3Q  + a^t(>l).  On  the  other  hand,  the  actual  cor- 
relation (h)  is : 


1 

t « t+h  ^ \ 7 


(17) 


and  I p j.  (h ) |-^x  (h)  ( ) , as  t-^p-  . Thus  for  such  time  series 

the  correlation  does  not  tend  to  zero  for  large  t and  large  h . 
The  correlation  characteristic  0j_(-)  magnifies  this  phenomenon. 
The  above  computation  also  implies  that  the  corre logram  ( = the 
graph  of  (h,p^(h)  ),  hsQ  , for  any  t ) does  not  dampen  as  the 
lag  h increases  if  the  coefficients  contain  a linear  time  trend. 
Since  the  same  character  is  maintained  in  using  c^(h)  instead 
of  Cj_(h)  and  since  ^^.(h)  is  computationally  simpler  than 
o^(h)  , it  will  be  considered  in  what  follows  for  a structural 
study  of  the  "explosive"  time  series.  The  resulting  graph  may  be 
called  an  approximate  correlogram. 

If  the  linear  trend  is  replaced  by  the  reciprocal  trend, 

^1 

i.e.,  a^.  = ^0  after  a similar  but  more  tedious 

computation  one  finds  that  5^  still  exhibits  nearly  the  same 
properties  unless  more  stringent  conditions  such  as  (8)  are  im- 
posed. The  details  are  omitted. 


(d)  Limiting  behavior  of  normalized  sums  from  class  (KF)  . The 
behavior  of  series  given  by  (3),  subject  to  a condition  implying 


23 


(8),  is  reasonable  in  that  such  series  obey  the  central  limit 

theorem  for  dependent  variables.  Let  S = X,+-*-+X  , X.=0,i=i0  . 

Suppose  that  (i)  the  are  independent  and  identically  distributed 

2 

with  means  zero  and  variance  , (ii)  the  -^(t,m)  = o(m)  is 

independent  of  t (which  is  implied  by  the  case  that  a^(-)  of 

00 

(3)  are  constants),  and  (iii)  S I'rjCm)!  ” . Under  these  con- 

m=l 

ditions  the  following  assertion  obtains: 

Proposition  3.2.  Let  the  time  series  [X^,t.^l:  be  generated  by 

(3)  and  let,  moreover,  conditions  (i)-(iii)  hold.  Then 


1 im  P I S <x  vA^ar  S 


1 . 2 . 

7*^  e du  . 

ZTT 

— CO 


Thus,  obeys  the  central  limit  law. 

This  result  follows  from  some  known  results  of  Diananda  and 

n 

Anderson  (cf.  [20],  Thm.  7.7.8).  In  fact,  X = Z)-r(m)e 

n n-m 

m-U 

T) 

'5  where  "Hni)  = 'c(m),  1-sm- n , = 0 otherwise.  Since  the 

_r\  n “lU 

m-0 


are  independent  and  identically  distributed. 


Var  S 


- 1 , as  a 


simple  computation  shows.  This  is  sufficient  to  invoke  the  above 
cited  theorem. 

The  restrictive  condition  (ii)  may  be  relaxed  in  some  cases. 
If  a^(t)  = a^+a^t”^,  t^l  , then 


'4j(t,m)  = 


^ ^k  (t-k,)---a,  (t-Sk.)  , k =0  , 

il+-  • -+k^=m  *^1  ^ '^i  j=l  J 0 


ki  K2 


, - O(^)  = -5(nn)  - O(^)  . 


Hence 


(20) 


One  checks  that  the  variance  of  the  last  term  in  (20)  is  o(-tt) 

t 

It  has  mean  zero.  So  if  , corresponding  to  the 


n 


n 


decomposition  of  (20),  then  S^-0  in  probability  and  'S^,nsl] 


n 


satisfies  (iii).  Hence,  from  a form  of  the  classical  Slutzky's 

theorem,  S and  h< 

* n n 

following  result  holds: 


theorem.  S and  S have  the  same  limit  distribution.  Thus  the 
* n n 


Proposition  3.3.  Let  [Xj.,t^l]  be  given  by  the  scheme  (3). 

_2 

Suppose  that  conditions  (8)  and  (i)  hold,  where  a^(t)  = a^+a^t 
If  5(m)  of  (19)  satisfies  (iii),  then  the  series  obeys  the  cen- 
tral limit  theorem,  i.e.  (18)  holds  for  this  series. 

It  is  clear  that  other  conditions  can  be  formulated  on  the 
coefficients  a^(t)  , to  obtain  corresponding  results.  Assuming 
that  the  -j-'s  have  four  moments,  this  result  with  a sketch  of 
proof  was  indicated  in  [15],  using  Lyapunov's  theorem  somewhat  on 
the  lines  of  Marsaglia  ([21],  Thm.  3).  However  Parzen  ([22], 
p.  254)  has  a better  result  on  these  problems. 

(e ) Approximate  recursion  equations  for  sample  covariances. 

Since  the  difference  equations  with  coefficients  depending  line- 
arly on  time  have  been  noted  to  be  of  interest  in  describing  trend 
variation  (cf.  [5]),  it  will  be  useful  to  have  recursion  formulas 
for  computing  sample  covariances  from  data,  even  though  the  serier 
is  not  in  class  (KF)  . Here  an  account  of  this  problem  will  be 
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presented  for  a first  order  scheme.  Similar  results  for  the 
higher  order  schemes  are  much  more  involved  computationally.  The 
recursion  equations  are  just  the  sample  analogs  of  the  ancient 
Yule -Walker  equations  of  the  autoregressive  systems  (cf.  [20], 
p.  174).  These  (sample)  equations  are  useful  fora  descriptive 
study  of  time  series. 

Consider  a time  series  defined  by  the  equation 


X. 


= (a.  +a,t)X^  +€, 


t::0 


(21) 


where  are  independent,  identically  distributed  mean  zero 

random  variables  with  finite  variance,  Xj_  = 0 for  t^O  so  that 
there  are  no  records  of  the  series  for  the  past  and  it  starts 
from  scratch.  Here  a^  and  a^^  are  unknown  parameters  and  can 
be  estimated  by  the  least  squares  method.  Thus  a simple  minimiz- 
ation based  on  N observations  gives  ^o^’^lN  estimators 

of  ^Q»^]  following  equations: 

N , , N N 


, N 

ioM  " ( 2:  tx„  , ,X,  '^1  S txf  : - : S t^xf  ;I  S x_x^ , , 1 I , 

ON  ^ = t+1  t t/  ^''  't  = l ^ 

N 

'N‘  't  = l 
N o 2 


_ 1 


‘IN  ti 


N 


N 


,2  , 


2 2 

/ 

N 


N 


(22) 


N „ 2 9 / N , 


2 

t' 


It  is  desirable  to  establish  the  consistency  of  these  estimators, 
i.e.,  to  show  that  i=l,2  , in  probability  as  N-^  . This 

is  true  if  a^  = 0 . The  work  in  ([18],  Thm.  5)  and  [19])  indi- 
cates that  the  general  statement  is  true  under  some  conditions  on 


the  distribution  of  - ' s . The  actual  details  are  nontrivial 


26 


• » . 


and  will  not  be  considered  here.  Since  the  general  behavior  of 
the  series  can  be  understood  to  some  extent  from  the  properties 
of  the  correlation  characteristic  (or  the  approximate  correlogram 
of  the  series)  the  sample  product  moment  equations  will  now  be 
derived  for  this  model.  This  already  shows  the  difficulties  involved. 

It  will  be  convenient  to  adopt  the  following  notation,  from 
[5],  for  simplifications.  Thus  set  (with  = 0,t-0  ) for  t:iO  , 

Zft  - , Z2(_  - tX^  , - l,6j^  - ' ~^1  ■ 


Then  the  equation  (21)  becomes 


■'O^lt+1 '*’^l^it  ■‘■^2^2t  't+1 


t.-0  . 


For  the  product  moments,  the  following  additional  abbreviations 
are  seen  to  be  useful. 


= 


’ e-  £■  9 = ' 7 7 

t = i't  t-Hc  ’ ^ik  it^it+k 


i=l,2  , 


N-k 


N-k 

— V'  r- 


I'l  s ^ 7 7 ' 7 7 

12  k ’ ^21  k ^ = ^ 2t^lt 


Since  6^.  = 1 , using  (24),  one  gets  after  a small  computation: 


^l^lk+1  ^^■'■^l^^lk  ^ H^lk-1  ^2^2k 


^2^^12k-l'^21k+l 


) + Si&2^^12k''^nk'^  ^ 


But  S 


S2j^j^+kS^j^  . So  (26)  can  be  simplified  as; 


'^l^lk+1  + S^l^_^(6^  + (k-l)f2)  + 


r +9t 

2 ‘^21k+l  ^n^21k  ^21k-l  '2‘^2k' 


This  is  the  sample  analog  (for  k-l  ) of  the  Yule-Walker  equation 
of  [20)  above.  Note  that  [E^,N-k;  is  a series  of  uncorrelated 
random  variables. 


If  the  "initial  point"  6 of  the  linear  trend  is  known  a 

priori  , then  (27)  can  be  recast  in  a better  form.  For  then,  if 

N-k 

we  set  Yj  - , Y^  - X^_j+6jX^  , 

't  l^t+k^  ’ expressed  after  a small  computation  as: 

‘^l^lk+1  2^52^^  ■ ^Ik+l^H"^'^'^^ -2^  ■ ^lk-2  " ^lk+1  ' 


(28) 


Treating  the  correlated  disturbance,  one  notes  that  the 

product  moment  equation  of  the  first  order  scheme  (21)  (or  (24)) 
is  a third  order  difference  equation  whose  coefficients  depend 
(linearly)  on  the  lag.  If  c|^  = , then  (28) 

reduces  to  an  equation  of  sample  covariances: 


*l^k+l  (1+^w  ■ ^k-2  \ 


(29) 


Taking  expectations  of  this  equation,  one  gets  the  Yule-Walker 
relations.  If  62  = 0 (so  there  is  no  trend),  then  (27)  and  (29) 
reduce  to  a corresponding  known  (standard)  case  (cf.  [20],  p.  124). 
Similar  considerations  with  a reciprocal  trend  (i.e.  a^.  = 

3q  + — for  (21))  lead  to  the  product  moment  equations,  corre- 
sponding to  (27)  or  (29),  with  coefficients  depending  on  the  re- 
ciprocals of  the  lag.  (This  and  a second  order  scheme  were  con- 
sidered in  [15],  but  the  computations  are  too  long  for  a treatment 
here.)  From  (29)  one  can  easily  obtain  the  correlation  character- 
ed 

istic  Cj^(k)  = — ^ , and  then  graph  the  approximate  correlogram. 

^0 

An  explicit  expression  for  this  can  be  obtained  from  (29),  by  the 
method  indicated  in  (4)-(5).  A formula  for  is  given  below 

from  (29)  without  the  intermediate  computation.  Let  fQ  = * 


28 


f^(k)  - 1 + 6^62k  = l+ka^aj^  , f^(k)  = -fj^+62(k-l)  = a^-(k-l)a,  , 


and  £2=1.  Then 

/-N  ^ V c-m 


where  (i)  = m , (ii)  kj^  = k,  k2  = k-tj^,  k3  = k-t^-t2 

etc.  The  graph  [ (kj^  ,pj^(k)) , lsk<N}  , for  large  enough  N , gives 
an  indication  of  the  dependence  behavior  of  the  time  series  de- 
scribed by  (21),  by  the  earlier  treatment. 


1 


SECTION  IV 


SERIES  GENERATED  BY  DIFFERENTIA].  EQUATIONS  : FLOWS 

(a)  Introduction . The  preceding  analysis  leads  to  the  continuous 
time  analog  (or  the  stochastic  differential  equations  case)  of  the 
problem  involving  again  nonstationary  time  series.  This  is  useful 
both  for  a comparison  with  the  discrete  case  above,  as  well  as 
for  an  independent  study.  It  also  brings  up  some  interesting  new 
problems . 

Let  ■' , t^T  ,T  c R}  be  a continuous  parameter  time  series 
( and  X(t)  are  synonymous)  governed  by  the  differential 

equation : 

+ a(t)  +b(t)X(t)  = -:(t)  (1) 

where  [-"(t),!^!’}  is  the  white  noise  disturbance  and  a,b  are 

real  functions  on  T . By  definition  of  white  noise,  s(t)  is 

the  (generalized)  derivative  of  Brownian  motion  (B(t),t€T}  ; and 
thus  (1)  is  a symbolic  equation  which  cannot  be  interpreted  in 
the  classical  sense  of  differential  calculus.  (Such  a problem 
does  not,  of  course,  arise  in  the  discrete  case.)  However,  the 
classical  computations  carried  out  form.ally  can  he  justified  (in 
the  integrated  form)  with  the  concept  of  a stochastic  integral 
replacing  s(t)dt  by  dB(t)  , and  this  will  be  made  precise 

below.  Potential  applications  of  this  mc^del  abound.  Taking  a = 0 , 

b(t)  = b'+b"t  , Hartley  [6J  indicated  an  industrial  application 
and  carried  out  a correlogram  analysis  of  the  X(t)-series  using 
classical  methods  (and  formal  computations).  In  fact,  assuming 
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tliat  the  "(t)  is  intej^riible  (in.  the  calculus  sense),  he  has 
carried  out  the  analysi.s  using  ''Airy  Integrals"  and  then  studied 


the  covariance  characteristic.  fin  a conversation  at  tlie  IM.S  meet- 
ings in  Ames , Iowa  in  1957,  he  mentioned  that  the  Weber  differentia] 
equation  method  would  be  better  suited  for  such  a problem. J If 
a,b  are  constants,  then  a related  problem  was  considered  by 
Nagabhushanam  ([23],  p.  482)  where  X(t)  is  called  a "primary 
process"  obtained  by  an  inversion.  Since  the  Brownian  motion  is 
nondifferentiable  in  the  classical  sense  so  that  the  -:(t)  of  (1) 
does  not  exist,  a slightly  different  route  will  be  followed  here 
to  validate  such  an  analysis  for  a solution  of  (1). 


(b)  A general  second  order  problem.  The  method  of  attack  here 
is  quite  simple.  First  consider  the  problem  with  a formal  manip- 
ulation and  express  the  solution  in  terms  of  an  integral.  If  v;e 
replace  s(t)dt  by  dB(t)  , where  {B(t),t€T;  is  the  Brownian 
motion,  and  then  interpret  the  integral  as  the  stochastic  in- 
tegral of  a nonstochastic  (or  "sure")  fvmction  relative  to  Brownian 
motion,  the  solution  is  rigorously  definable.  [Of  course,  the 
s (t ) -process  v;ill  not  be  as  general  as  in  [6],  but  the  [)rcscnt 
assumption  will  be  in  force  throughout  this  section.  For  a rigor- 
ous treatment,  some  such  restriction  is  necessary.] 

The  differential  et]uation  (I),  written  symbolically  as 


^ z 

j 


dX(t)  + a(t)X(t)dt  + b(t)X(t)dt  = dB(t)  . 


(2) 


is  then  regarded  as  the  equation  leading  to  a well-defined  solu- 

d.X 

tion,  where  X(t)  = ^ . To  make  this  more  precise,  let  T = (a^,,h^) 


0’  O' 
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a bounded  interval,  and  a(-),b(-)  be  continuous  real  functions 

_ . ra(t)  b(t)-, 

on  T . Set  Q = X , A(t)  = i , , W(t)  = ' , "(t)  = 

^-10-^  ^0 

r ■' (t)  , -Q(t)  , 

and  Z(t)  = I I . Then  (1)  may  be  expressed  compactly 

^ 0 ^x(t)-' 


dZ(t)  + A(t)Z(t)dt  = "'(t)dt  = dW(t)  . (3) 

To  solve  this  (vector)  differential  equation  with  a standard  method 
in  the  classical  theory  of  ordinary  differential  equations,  consider 
the  2-by-2  matrix  differential  equation  associated  with  the  homo- 
geneous part  of  equation  (3),  i.e.,  the  (nonstochastic)  equation: 


dY(t)  = Y(t)A(t)  , 


t€T,  det(Y(aQ))/0  , (4) 


where  "det"  stands  for  determinant.  Then  premultiplying  (3)  by 
Y(t)  and  using  (4)  one  gets 

^(Y(t)Z(t))  = Y(t)^(t) 

so  that  formally  one  has  the  solution  of  (3)  as: 

Z(t)  = Y(t)‘^  ; Y(u)-|(u)du +Y‘^(t)Y(aQ)Z(aQ)  . ( 


The  fact  that  Y(t)  satisfying  the  equation  (4),  if  nonsingular 
for  one  t€T  , has  the  same  property  for  all  t€T  is  used  here. 

This  is  because  (4)  implies  det(Y(t))  = det  (Y(ap.)) -exp  (^’^trace  (A(u)))du) 

U 

(cf.  Coddington  and  Levinson  [24],  p.  28).  Thus  (5)  is  well  de- 
fined and  Z(t)  is  obtained  as  soon  as  Y(t)  is  solved  from  (4). 

Since  Y(t)  ^ is  bounded  for  each  t , it  can  be  taken  inside 
the  integral  also.  Thus  (5)  can  be  expressed  as: 
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(6) 


Z(t)  = ;Y(t)'^Y(u)dW(u)  + Y‘^(t)Y(aQ)Z(aQ)  , 

^0 

where  the  first  term  on  the  right  is  now  rigorously  defined  as 
the  stochastic  integral  of  the  first  kind  (see  Doob  [25],  p.  352). 
The  uniqueness  of  the  solution  is  immediate  for  the  given  initial 
condition  , because  if  Z is  another  solution,  then  Z-Z 

will  be  a solution  of  the  homogeneous  equation  ^+A(t)U(t)  = 0 , 
with  ~ ^ initial  condition.  This  is  a nonstochastic 

equation  and  the  standard  theory  implies  that  U=0  is  its  only 
solution.  Thus  Z = Z . Hence  it  remains  to  find  Y(t). 

Since  (4)  is  a nonstochastic  equation,  one  can  apply  the 

« /'{■  — iV 

classical  Picard  method  of  approximation.  Writing  A = A , Y = Y 
( * for  transpose)  and  integrating  (4),  one  finds 


Y(t)  = Y(aQ)  + A(u)Y(u)du  . 


(7) 


‘0 


Now  substituting  for  Y and  iterating,  one  obtains 

t t *'n-L 

Y(t)  = Y(3q)  + ; A(t^)Y(aQ)dtj+- • •+;  A(tj)  ; A(t2)  - A(t^)Y(aQ)dt^--dt 


‘0 


‘0 


0 


'0 


(8) 


where 

t *"1  *'n 

\ A(tj^)  J’ A(t2)  • • A(u)Y(u)dudtj^- • -dtj^  . 

aQ  aQ 

By  hypothesis  a(-)  and  b(-)  are  continuous  on  the  compact  in- 
terval T . So  "A(t),,  = ^ ^trace  (A(t  )A(t ) ) - M : , t€T  , and 
similarly  ,,Y(t),|  i.  N < ® . [Here  N is  obtained  as  follows.  Let 
^l’^2  linearly  independent  pair  of  vector  solutions  of  the 
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homogeneous  equaLiun  of  (3).  Then  these  are  continuous  on  T . 


It  is  the  upper  bound  on  the  norms  of  the  vectors  , 

i = l ,2  , then  Y = (y|,y^)  in  (4')  so  that  iY,'  u/2Nb  = N .]  Con- 
sequently 


“Trr- 


Hence  uniformly  in  t as  n-'^  , and  the  series  in  (8)  con- 

verges absolutely  and  uniformly  and  defiiies  a solution  of  (4)  . In 

t ^ 

particular,  if  a(.t,tjj)  - J A(u)du  , then 

^0 

t ^l~ 

A(tj^)  J A(t2)dt^dt^  = ^ A(t^)A(t2.)dt2dtj^  , 

aQ  “ aQ-t2s-tj^^it 


ao^t2  t 


1 > f 2 ^^2 '^^^2  ' tC2(f)dQ)  , say. 


t - 7~  ?~ 

Similarly  i^(t,ag)  - ' A(t A(t2)  A(t2)dt^dt2dt^  . Then  (8)  can 


be  expressed  more  convenient  iy  (by  setting  UQ(t,ay)  -identity  ) as  : 


Y*(t)  = Y(t)  = Z:  a^(t,aOY(a„)  . (10) 

n=0  " ^ ^ 

As  yet  no  special  properties  of  Brownian  motion,  other  than 
the  definition  of  (6),  were  utilized.  Let  Z(aQ)  = C be  a con- 
stant (nonstochastic)  initial  condition.  (The  existence  and 
uniqueness  of  the  solution  of  (3)  rigorously  holds  if  only  ZCoq) 
is  independent  of  B(t)-B(aQ)  . However,  this  is  not  sufficient 
for  the  following  analysis.)  Also  the  continuity  of  a(-)  and 
b(')  is  not  crucial.  if  a('),b(-)  are  integrable  on  T , then 


one  sees  easily  that  the  bound  in  (9)  holds  (cf.  also  [24 J,  Problem 
1,  p.  97),  and  the  rest  of  the  argument  is  valid.  Thus  one  may 
state  the  following  simple  but  important  result. 

Theorem  4.1.  Let  T = [aQ.by)  be  a bounded  interval  and  B(l),tfT,t 
be  the  Brownian  motion.  If  [X(t'),t€Tj  is  a time  series  generated 
by  (2)  with  a(-),b(-)  as  the  (Lebesgue)  integrable  real  functions 
on  T , then  there  is  one  and  only  one  such  series  for  each  initial 
condition  X(a)  - Cj,  X(a)  = C2  where  real  constants. 

The  solution  Z(t)  = , of  (3)  is  given  by  (6)  where  Y is 

"X(t) 

defined  by  (10).  Moreover,  [Z(t),tfT]  is  a vector  Markov  Gaussian 
time  series,  almost  all  of  whose  trajectories  are  continuous. 

Proof . Because  of  the  preceding  discussion  and  ca]  ciil  ations  , only 
tlie  proof  of  the  last  statement  remains.  Note  that  by  the  classi- 

I • 

cal  theory,  the  function  Y:T-lR'*-'0  is  continuous  and  so  also 

is  Y ^ . By  some  well  known  properties  of  the  simple  stochastic 

integrals  (cf.  [13J,  Ch.  9)  the  integral  in  (6)  is  a continucus 

function  of  t with  probability  1 . It  follows  that  the  Z(t)- 

[irocess  has  almost  all  continuous  trajectories  with  values  in  1\^  . 

By  definition,  the  integral  in  (6)  is  the  mean  square  limit 

n 

of  approximating  sums  of  the  form  S Y ( t • ) (W( t . , , ) -W t . ) ) , where 

i=l  ^ ^ ^ ^ 


a„  = t,  Lo<---<L  ‘--t  . But  since  Y(t.l  is  nonstocliast  it  and 
W (t  j ^ 1 ) -W  (t  ^ 1 are  independent  Caus.sian  vectors,  the  above  is 
Gaussian  distributed.  Hence  its  1 imit -in-mean  (i.e.  the  integral) 
defines  a Gaussian  random  vector.  Since  Z(aQ)  = G . it  follows 
from  (6)  that  the  ^Zlt),!*^’!''  is  a vector  Gaussian  time  series, 


r 


I 

i 

I 


having  almost  all  continuous  sample  paths.  Finally,  (6)  is  true 
if  a't  is  replaced  by  t,t+h  (h>0),apairofpointsin  T.  Thus 

t+h  , , 

Z(t)  = J Y(t+h)"  Y(u)dW(u)  +Y  ^ (t+lT)Y  (t)Z  (t)  . (11) 

t 

By  the  preceding  definition  of  the  integral,  Z(t)  is  determined 
by  Y(t)  and  W(u)  for  aQ'^u^^t  only.  Since  W(-)  has  inde- 
pendent increments,  (11)  is  determined  by  W(t^_^j^)-W(t^)  for 

f^t^<t^_j_j^^t+h  , and  is  independent  of  Z(u)  for  a^u<t  . This 

2 

means  for  each  interval  A c R , t^tg  , 

P[Z^€A|Zg,s.tg]  = P[Z^€A|Zg]  , (12) 

with  probability  one.  But  this  implies  the  Markovian  property  of 
the  Z(t)  , and  completes  the  proof. 

Remark . In  general  the  Z-process  need  not  be  a martingale  and 
the  X-process  need  not  be  Markovian.  Note  that  the  cases  a(t)  = 
a'+a"t  and  b(t)  = b'+b"t  (the  linear  trend,  and  similarly 
the  reciprocal  trend  if  T = [aQ,bg],ag>0  ) is  included  in  the 
above  treatment.  Another  model  treating  seasonality  (i.e.  a(t)  = 
^1  ^^2  ~ ^1  '*''^2  t ) of  the  coefficients  considered 

itv  ([5],  p.  334)  is  also  included.  However,  the  latter  case  has 
some  special  properties  worthy  of  a special  treatment,  but  is  not 
considered  in  the  present  paper.  It  is  also  clear  that  the  above 
theorem  is  valid  without  real  changes  if  the  order  of  the  equation 
is  n^2  . In  that  case  the  Y(t)  and  A(t)  are  n-by-n  matrices. 

From  (6)  it  is  easy  to  calculate  the  mean  and  covariance  of 
the  Z(t)-vector  series.  In  fact,  if  m(t)  = E(Z(t)),  <'C(t,s)  = 
Cov(Zg,Z^)  , then  from  the  condition  that  Z(ag)  = C , a constant. 
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one  has  : 


m(t)  = Y'^(t)Y(aQ)C  . (13) 

and 

S(s,t)  = E[ (Z(s)-m(s)) (Z(t)-m(t))*) 

= E((;Y(t)'-^Y(u)dW(u))(^’  Y(s)"^Y(r)dW(r))'‘] 

^0  ^0 
S A t 

= , Y(t)  ^Y(u)(qqJY  (u)  ^Y  (s)  ^du  , SAt=min(s,t)  , 

^0 

where  an  elementary  property  of  the  stochastic  integral  is  used 
in  the  last  line.  If  D(t,u)  is  the  first  column  of  Y(t)"^Y(u) 
Chen  (14)  can  be  written  as; 

SAt 

(’ij(s,t))  =S(s,t)  = ; D(t,u)D(s,u)''^du  . (15) 

^0 

This  is  the  2-by-2  covariance  matrix  function  of  the  vector  Z(t)- 
series,  which  is  (hermitian)  positive  definite  for  all  a^  s,tsb  . 
From  this  it  follows  immediately  that  the  covariance  function  of 
the  X-series  ( r(s,t)  = Cov(Xg,Xj.)  = ’22(3, t)  ) is  given  as: 

r(s,t)  = ; (D(t,u)D(s,u)' )22du  (16) 

^0 

where  ( )22  is  the  second  diagonal  element  of  the  matrix.  If 
d(s,u)  is  the  second  element  of  the  vector  D(s,u)  , then  (16) 
is  just 

SAt  ____ 

r(s,t)  = d(s,u)d(t,u)du  . (17) 

Thus  Che  time  series  determined  by  (2)  is  always  of  class  (C)  . 


(14) 
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It  is  interesting  to  note  tiiat  tlie  covariance  function  r of 
(17)  is  really  the  Green  function  of  the  lioniogeneous  ordinary 
differential  equation  of  (1)  with  zero  initial  conditions,  i.e. 
X(t)  = X(t)  = 0 at  t = a^j  . This  useful  result  may  be  derived 
as  follows. 

Consider  the  homogeneous  equation 

2 

h(X)  = -1  a(t)  +b(t)X(t)  = 0 , (18) 

dt 

where  X(a)  = Cp  X(a)  = C2  , as  the  initial  data.  If  U^(a)  = 

•X^^  *\a)  where  X^*^^  = X , X^^^  =X  = ^ , then  by  the  standard 
theory  (c  f . (24])  the  system  L(X)  = 0 and  Uj^(aQ)  = 0 has  a 
unique  solution,  say  Vj  . Similarly  L(X)  = 0 with  Uj  (aQ)  = 0, 
= I has  a unique  solution  V2  • If  C(-,-)  is  the  Green 
function  associated  with  L(X)  = 0,  X(Oq)  = 0 = X(a^)  , then  the 
unique  solution  of  (2)  with  the  initial  condition  Z(a)  - C is 
given  (cf.  Ince  [26],  p.  257,  and  the  discussion  on  the  sto- 
chastic analog  following  (2))  by; 


X(t)  = ; G(t,u)dB(u)  f C 'V(t)  , 
a. 


(19) 


0 


where  V - 


1 


'1 


LVb 


and  C = I 
uG2^ 


Here  G is  continuous  on  TxT 


th 


and  differentiable  (in  general  (n-l)  times  for  the  n order 


equation),  and  — is  continuous  in  (t,u)  for  the  range 
a«  t u-  b- 


0 


0 • 


'5t 

Moreover , 


|^(u-K),u)  - = 1 


Thus  from  (19)  one  has  mj^(t)  = E(X(t))  = c"V(t)  , and 
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S t _ 

r(s,t.)  = Cov  (X  (s ) ,X  (c  ) ) ~ " G (s  ,u)C;TT,u)du  . (20) 

A comparison  of  (l‘-')-(20)  with  (16)-(17)  shows  that  G(s,n)  “ d(s,u) 

The  form  of  this  equation  siiould  also  he  compared  witli  a result 
of  Cramer  (|27l,  p.  18)  in  terms  of  which  X(t)  has  multiplicity 
one.  (For  the  definition  and  properties  of  the  latter,  cf.,  f27J.) 

The  preceding  work  may  he  summarized  in  the  following: 

Theorem  4.2.  The  vector  Gaussian  Markov  process  Z(t),t-'i  of 
Theorem  4.1,  has  mean  and  covariance  given  by  (13)  and  (15).  The 
solution  process  ''X(t),t‘^Tj  of  (2)  is  given  by  (19)  with  its 
covariance  function  by  (20)  or  (17),  and  it  is  of  type  (C)  . If 
moreover,  the  Green  kernel  G(-,-)  of  (20)  satisfies  an  appro- 
priate growth  condition,  in  particular  if  G(,u)  is  a.p.  uni- 
formly in  u on  compact  subsets  of  T , then  the  solution  process 
X(t),t-'^T’  is  in  class  (0)301338  (KF) 

i 

Remark . If  a(t)  = +a.^t,  b(t)  = bj^  +b2t  . then  the  resulting 

solution  process  in  the  above  theorem,  while  being  in  class  (C)  , 
will  not  be  in  class  (KF)  . In  any  case  this  solution  has  ''multi- 
plicity'' one  in  the  sen.se  of  ([27),  p.  11).  This  problem,  and  the 
work  of  Section  11  above  show  that  the  classes  (C)  and  (KF) 
are  not  included  in  each  other. 

In  view  of  the  preceding  result,  it  will  be  of  considerable 
interest  to  analyze  and  extend  the  detailed  treatment  of  [8]  from 
the  constant  coefficient  case  to  the  general  case  which  is  a 

solution  process  of  (2).  Many  of  the  results  of  [8]  have  non-  j 

trivial  extensions  to  the  present  one.  It  needs  and  deserves  a j 
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separate  treatment  and  will  not  be  considered  at  present.  In 
the  next  paragraph  a special  problem  is  discussed  for  the  properties 
of  its  correlogram,  as  it  enables  a better  appreciation  of  the 
time  series  generated  by  (2). 


(c)  A special  case.  Let  a(t)  = a , b(t)  = b , t€T  . Then  Y(-) 

f ^ ^'1 

can  be  calculated  explicitly  in  (10).  For,  A(t)  = A = I q|  so 

v2 

etc.  and  hence 


that  a(t,t^)  = A (t-tQ>,  a2(t,tQ)  = A 


*2  (t-tQ) 


Y"(t)  = Sa 
n=0 


n! 


T Y (ag)  = (exp(t-a^)A  )Y  (a^,) 


0' 


‘O' 


Consequently  (6)  can  be  simplified  to 

Z(t)  = ; e*^‘^"^^^dW(u)  +e^  ° , 


(21) 


^0 

where  the  facts  that 
used.  From  this,  if 
yields 


uA  , 
e and 


e commute  and 
^dj^(t-u)  d2(t-u) 
vd2(t-u)  d^(t-u)j 


Z(ap)  = C were 
, then  (21) 


t 

X(t)  = dj^(t-u)dB(u)  + dj^(a„-t)cj^  +d2(aQ-t)c2  , 

^0 

t 

X(t)  = ;d  (t-u)dB(u)  +d3(a  -t)c^  +d^(ap-t)c2  . (22) 

^0 


Comparing  these  equations  with  (19)  one  obtains  G(t,u)  = G(t-u)  = 
d3(t-u)  , and  G'(t-u)  = d|^(t-u)  where  G is  the  Green  function 
associated  with  (2).  (In  the  case  of  constant  coefficients,  G is 
only  a function  of  the  difference  of  its  arguments.)  The  covari- 
ance is  thus  simplified  to 


40 


(23) 


r(s,t)  = ’ G (s -u)G (t-u)du  . (23) 

b 

Even  now  r is  not  a stationary  covariance,  and  the  solution 
process  need  not  be  in  class  (KF)  without  further  conditions. 

In  the  particular  case  that  a = 0,  b>0  in  (21)  with  T = 

[0,0.)  , the  covariance  (23)  can  be  simplified  further.  Then, 
d^(t)  = sin/bt  , and 

SAt 

r(s,t)  = ’ sin  ^b  (t-u)  sin  Ab  (s-u)  du  . (24) 

b 

If  t = s+k  , then  the  correlation  character  (k)  = r (s , s+k) /r (s , s ) 
is  reduced  to : 


(k)  = ^ 


sin/b(k+s-u)  sin/b(s-u)  du 


s in  /b (s -u) du 


_ 2s/b  cos  /b  k -t  sin/b  k - s in  /b  (k-t2s ' 
2s/b  - s in  2 ''b  s 


For  large  s , °g(k)  therefore  behaves  as  cos /b  k , and  hence 

the  approximate  correlogram  is  essentially  a harmonic  curve.  The 
above  computation  also  shows  that  for  small  t , r(t,t)  = 

^2  b 3 

sin  /b  udu  - -^t  . Similar  estimates  can  be  obtained  for 

0 ^ 

.T^j(t,t)  . Such  calculations  were  carried  out  in  ([8],  p.  135) 
using  different  arguments,  and  both  these  results  agree.  The 
Gaussian  character  of  Z(t)  , when  a(t)  = a , b(t)  = b. 0 , and 
various  moments  have  long  been  established  in  [7],  with  classical 
techniques.  It  will  thus  be  interesting  to  carry  out  the  corre- 
sponding study  for  the  case  of  variable  a(-),b(‘)  » e-g-.  if 


these  are  pei'ioJic  or  more  generally  (real)  analytic  functions. 

The  result  of  Theorem  4.1  admits  substantial  extensions  for 
vecLor  valued  processes  and  the  coefficients  can  then  be  matrix 
valued  integrable  functions.  Such  an  extension  has  been  carried 
out  by  Goldstein  [9J  using  suitable  abstract  methods.  His  re- 
sults subsume  all  the  previously  known  existence  studies  on  the 
problem.  The  natural  cjuestion  here  is  to  consider  (and  this  ap- 
pears more  difficult)  his  results  in  classifying  the  solutions  in 
the  sense  ot  Dym's  work. 
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